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(54) Interactive Instructional system using adaptive cognitive profiling 

(57) An Interactive instructional system realizing an 
eventstream based educational methodology and ena- 
bling an interactive, adaptive learning environment. 
Continuously tracking and evaluating learner interac- 
tion, the system creates and updates a profile of the 
learner's cognitive style and achievement level. Using 
this cognitive profile, the system adapts Its presenta- 
tions to the learner's cognitive style and demonstrated 
ability. Presentations take the form of eventstreams, 
which are branching sequences of multimedia objects 
called events. Some of the events contain substantially 
similar content presented in differing ways so that, using 
the learner's cognitive profile, the system can select the 
event that results in the greatest comprehension of the 
presented material. This selection Is accomplished 
using a utility function that is based on the cognitive pro- 
file and that provides a measure of the teaching utility of 
each of the different cognitive styles. The system can 
adapt to the learner by updating the utility function 
through the use of preference relations which are deter- 
mined through testing and that Indicate that of the cog- 
nitive styles results In the greatest comprehension by 
the learner of the content contained within the presenta- 
tions. The system includes an eventstream develop- 
ment environment which allows the content developer 
to use accessible libraries of events to create new 
eventstreams. The eventstreams are structured to fol- 
low the paradigm of observed history so that each topic 
can be presented in the historical context in which it 
developed. 
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Description 
TECHNICAL FIELD 

[0001 ] This invention relates generally to computer- 
based instructional systems and, in particular, to 
instructional systems that have the ability to adapt to the 
learner. 

BACKGROUND OF THE INVENTION 

[0002] Traditional educational technology has as its 
basic object subjects or topics. It uses a lecture-based 
model to transfer content to the learner. During the lec- 
ture, the material is presented verbally, often with the 
help of visual, audio, textual and other such aids. In 
most instances, the learner's involvement in the lecture 
is minimal and mostly passive. The concepts or ideas 
that appear in a lecture-based presentation of a subject 
are usually presented in an order corresponding to the 
logical dependencies between them. Other than the 
subject of history itself, the historical context and histor- 
ical development of a particular subject or topic is sel- 
dom more than a footnote. 

SUMMARY OF THE INVENTION 

[0003] To overcome the disadvantages of the lec- 
ture-based model utilized by most educational technol- 
ogy, the present invention provides both a new 
approach to learning methodology as well as new tools 
for their implementation. The new tools are based on 
adaptive computer programming technology. The 
instructional system can be implemented or run on most 
existing computing devices. The invention provides a 
complete electronic learning environment which adapts 
continuously to the cognitive style and learning capabil- 
ities of the learner, meaning that the system adapts to 
the way that learner processes new information. 
[0004] In accordance with one aspect of the inven- 
tion, there is provided an instructional system for con- 
structing an adaptive interactive educational 
presentation for use by a learner on a computer work- 
station. The system includes : 

(a) means for providing a plurality of related event 
objects, each of which includes different content 
that is topically related to the content of the other of 
the event objects, and each of which has at least an 
audio, textual, or visual component that can be pre- 
sented via the computer workstation; 

(b) means for providing a number of additional 
event objects, each of which includes content that is 
substantially the same as the content of a corre- 
sponding one of the related event objects, and each 
of which provides a presentation of content that is 
different than the presentation provided by the cor- 
responding related event object; and 



(c) means for providing an eventstream having the 
structure of a branching sequence of nodes, each 
of the nodes representing one of the related event 
objects and any of the additional event objects cor- 

5 responding to that related event object. 

[0005] Each event object, or simply "event," can be 
a multimedia file with the eventstream comprising a 
tree-like structure of event objects that defines the inter- 

10 active educational presentation. The eventstream can 
be created as a script that identifies the event objects 
within the eventstream and that defines the branching 
sequence of event objects. The different presentations 
provided by the event objects having substantially siml- 

15 lar content is accomplished by placing differing empha- 
ses on the audio, textual, and visual components used 
in the presentations. 

[0006] The different event objects having substan- 
tially similar content are designed to accommodate dif- 

20 ferent learner's differing cognitive styles. For this 
purpose, each cognitive style and learner has a cogni- 
tive index associated therewith. Then, the learner's cog- 
nitive index can be used to determine which of two or 
more event objects covering substantially similar con- 

25 tent will be presented to the user as a part of the event- 
stream. Preferably, the selection between two or more 
event objects is accomplished using a utility function 
that is unique to the learner and that provides a meas- 
ure of the teaching utility of each of the different cogni- 

30 tive styles. The system can adapt to the learner by 
updating the utility function through the use of prefer- 
ence relations which are determined through testing 
and which indicate which of the cognitive styles results 
in the greatest comprehension by the learner of the con- 

35 tent contained within the presentations. 

[0007] In the broader aspects of the invention, there 
is provided an instructional system for presenting infor- 
mation on a computer workstation. The system 
includes: 

40 

(a) means for providing a plurality of computer-dis- 
playable presentations, some of which provide dif- 
ferent topically-related content and others of which 
utilize different cognitive styles to present substan- 

45 tially similar content, wherein the different cognitive 
styles each has a cognitive index associated there- 
with; 

(b) means for providing a cognitive profile for a 
learner; 

50 (c) means for selecting at least one of the other 
presentations using the cognitive profile associated 
with the learner; and 

(d) means for providing the learner with an ordered 
sequence of the presentations that includes the 

55 selected presentations. 

[0008] This system can be used to provide presen- 
tations over a global computer network, such as the 
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Internet, in which case the computer-displayable pres- 
entations can comprise web pages that are provided 
over the global computer network for display on the 
computer workstation. A cookie or other such informa- 
tion can be stored on the user's computer workstation to 
identify the cognitive profile associated with the user. 
Then, in use this cookie could be accessed by the 
server and used to select the web pages provided to the 
user. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] A preferred exemplary embodiment of the 
present invention will hereinafter be described in con- 
junction with the appended drawings, wherein like des- 
ignations denote like elements, and: 

Figure 1 is a block diagram of the structure of a pre- 
ferred embodiment of the instructional system of 
the present invention; 

Figure 2 is a diagram depicting an exemplary 
sequence of events that can be used in construct- 
ing an eventstream for use by the system of Fig. 1 ; 

Figure 3 is a flow chart showing the basic learning 
cycle used by the system of Fig. 1 ; and 

Figure 4 is an example of a portion of an event- 
stream showing how content can be presented 
within its historical context. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

Overview 

[0010] The present invention can relate to compu- 
ter-based technology that can be used for instruction or 
presentation of material, either on a stand-alone com- 
puter or over a public or private network. The preferred 
embodiment is referred to herein as the Instructional or 
Learning System and is used to provide an interactive 
adaptive learning environment where its learning com- 
puter applications can be developed and run. It is multi- 
ple platform technology and designed to run on major, 
existing machine operating systems. A graphic environ- 
ment interface enables the learner to navigate through 
the Learning System's presentations and learner tests. 
The presentations, referred to more generically as 
events or event objects, each comprise a multimedia file 
(such as an avi clip) that can be run on the computer. 
Topically-related events are organized together into an 
eventstream, which can have the structure of tree such 
that the eventstream comprises a branching sequence 
of events. Thus, the milestones of topic development 
form an eventstream. An eventstream's appearance 
corresponds to the way this invention organizes the 



events that make up a topic. The system provides the 
toots necessary for developing eventstreams from its 
own event library or an external library. 
[0011] The Learning System emphasizes In its 

5 approach to instruction the concept that knowledge is 
interrelated. By focusing on knowledge as a fabric of 
interrelated ideas, the Learning System encourages 
abstract thinking. In addition to being a system of ideas 
with mechanisms for extending it like deductive reason- 

10 Ing and reasoning by analogy, the body of knowledge on 
a particular topic has a life of its own. The story of that 
life can be more informative than the simple highlights of 
it (i.e., more informative than the historical events or 
developments themselves), since the manner in which 

15 the events developed are part and parcel of that same 
story. 

[0012] More specifically, the educational methodol- 
ogy on which Learning System is based structures 
material following the paradigm of observed history. It 

20 allows the developer to order events in variety of differ- 
ent ways. Each new idea or concept that has arisen has 
done so in a context that motivated it or even necessi- 
tated Its formulation. The additional Information that a 
context provides makes the events surrounding them 

25 seem more natural. Part of the reason for this has to do 
with the conceptual culture of ideas. Presenting knowl- 
edge in an order that more closely resembles the fabric 
of knowledge awakens some of the original insight. 
Events, in the sense of occurrences or facts, no longer 

30 stand alone or only as a part of a single subject. The 
events of the Learning System are Instead easily incor- 
porated into any of the Learning System's event- 
streams. The system's ways of manipulating 
eventstreams reflect the way in which individual ideas 

35 and concepts fit into that body of knowledge. 

[0013] The Learning System is an interactive sys- 
tem that adapts to the cognitive style of the learner, 
repeatedly challenging the learner's comprehension 
and facility with the material presented and adjusting 

40 the level of the material to the level of ability demon- 
strated by the learner. This is accomplished by con- 
stantly adjusting the interactions with a given learner 
based on its previous interactions with that user. These 
interactions can include, e.g., testing, choices of format- 

45 ting for the events in eventstreams, onscreen tools avail- 
able to the learner and many others. 
[0014] The system is open to contents provided by 
third parties. It presents a development environment 
Into which material is Introduced in a manner that can 

50 be utilized by the system. Learning plans (i.e., event- 
streams) are developed from the material supplied by 
the contents provider. Plans can be changed as 
needed. The system provides the learner with the mate- 
rial selected and may provide additional materials 

55 depending upon the freedom to learn that is granted the 
learner. 

[0015] Referring now to Fig. 1, the Learning Sys- 
tem, designated generally as 10, has three distinct inter- 
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faces to the different groups 12 of users of the system : 
one to learners 14 themselves, another to learning ^cil- 
itators 16. and a third to contents providers 18. The 
learner interface (LI) 20 presents multimedia objects to 
the learners 14. The learning facilitator interface (LFI) 
22 enables, among other things, the learning facilitator 
16 to create lesson plans (eventstreams) and toggle 
between eventstream settings that are fixed by the con- 
tent provider 18, The third interface is for content provid- 
ers 18 and is an eventstream development environment 
(EDE) 24. This latter interface enables content provid- 
ers 18 to load correctly formatted multimedia objects 
into the Learning System 10 in order to develop new 
eventstreams. It also enables the contents provider 18 
to connect events in accordance with the structural 
requirements of an eventstream. The learning facilitator 
interface 22 allows the development of learning plans. 
Features include the ability to establish the core of 
knowledge to be covered as a base, enhancements to a 
core of events and concepts to be presented to all learn- 
ers, and advanced presentations available to selected 
learners based upon demonstrated ability or other crite- 
ria. There are also system defaults that the facilitator 
can accept in lieu of custom settings. 
[0016] The Learning System 10 includes an infer- 
ence and condensation engine (ICE) 26 that absorbs 
learner data. The inference and condensation engine 
26 develops strategies for the learner 14 from an initial 
set of learner responses and appropriate strategies. It 
also tracks learner cognitive preferences and progress 
using a knowledge base of continuously updated 
learner profiles. Thus, the inference and condensation 
engine 26 is what enables the adjustment of system 
presentations to the cognitive style and ability level of 
the learner. 

[0017] Learning System 10 also includes an event 
management system (EMS) 28. Its structure and opera- 
tions embody some of the ways in which people com- 
monly organize concepts and ideas into clusters with 
links or references between them. Event management 
system 28 manages not only the event objects them- 
selves, but also the applications or programs that actu- 
ally created the multimedia objects. If there are several 
different application programs then event management 
system 28 operates to open the various events using 
the appropriate programs when required by the event- 
stream. The event objects are multimedia files stored in 
one or more learning system databases 30, which can 
either be local storage or remote storage accessible 
over a network, in which case a database server 32 can 
be used to access the event objects. 
[0018] As will be understood by those skilled in the 
art. Learning System 10 can be implemented as an 
application and can be designed for different operating 
systems. Including, but not limited to, Microsoft 
Windows95TM or Windows98TM and successors, Win- 
dowsNTTM Workstation, UNIX and its variants, and 
LINUX. 



Events and Eventstreams 

[0019] An eventstream is a sequencing structure 
that, in its most typical use. follows the standard notion 

5 of time and the timeline representation of a sequence of 
events. Fig. 2 provides a simple example of such a 
sequence of events. An eventstream is a program or 
script written in the scripting language of the event- 
stream development environment (an EDE script) that 

10 controls the sequencing of the multimedia event 
objects. The eventstream development environment 
provides an object oriented graphic interface to its 
scripting language and enables a content provider to 
create eventstreams using events available locally on 

15 the content provider's own memory devices or events 
available on an available network. The events and links 
of an eventstream can be indexed in much the same 
way a database may be. This indexing aids the content 
provider in constructing new eventstreams. Thus, the 

20 Learning System's eventstream development environ- 
ment provides the tools necessary for manipulating mul- 
timedia objects to construct an eventstream. To clarify 
the basic functioning of the eventstream development 
environment, a simplified example of Learning System 

25 content will be discussed further below in connection 
with Fig. 4. 

[0020] The linking of events in an eventstream is 
realized by an EDE script and not by the usual publicity 
devices like buttons or highlighted text. The EDE script 

30 describing an eventstream can be thought of as a les- 
son plan with several different possibilities at each point. 
The branching in an eventstream arises for two reasons. 
As will be described below, there will generally be sev- 
eral different versions of each event, corresponding to 

35 differing cognitive profiles. Another reason for branching 
in an eventstream is to enable the choice of settings 
available to the learning facilitator. The learning facilita- 
tor may choose to mask, i.e., make invisible or Inacces- 
sible, certain of the events generally available to the 

40 learner in an eventstream. Ultimately, the cognitive pro- 
file of the learner maintained by the inference and con- 
densation engine 26 may be used to give each learner 
automatically a 'learning clearance level' which expands 
or contracts the extent and depth of the events available 

45 to that learner. 

[0021] As a mathematical structure an eventstream 
is a directed graph with no cycles and no isolated 
nodes. One node in a given collection of nodes X is 
accessible from another node in X if there is a sequence 

50 of directed edges of length k>0 leading through nodes 
in X starting in the first of these nodes and ending in the 
second. A node m in a tree T is a root of T, if every node 
in T Is accessible from m. It can therefore be shown that 
all trees have at least one root. As used In the Learning 

55 System, the eventstreams are designed with only a sin- 
gle root. A set of nodes in a tree is called a branch of the 
tree if that set is a maximal linearly ordered subcollec- 
tion of the nodes in the tree. Maximality indicates that no 
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other nodes from the tree may be added to the branch 
without destroying its linearity. A set is linearly ordered If 
for any two nodes either one precedes the other In that 
ordering or follows it. The effect is that a branch is a path 
leading from the root of the tree all the way to some leaf 5 
In ^ct, a branch in an eventstream corresponds to the 
path taken by some learner who starts and completes 
the lesson represented by the eventstream. 
[0022] An eventstream should be regarded as a 
procedure, which, if executed, returns a collection of 10 
objects. For example, it can be described completely by 
specifying an aspect or property of event objects. 
Aspects are embodied as summaries associated with 
any object name. If the object collection returned were 
not to have all the properties of a tree, e.g. have isolated is 
nodes or more than one root, then the Learning System 
will return an error message. If this occurs while a devel- 
oper is composing an eventstream in the Learning Sys- 
tem eventstream development environment EDE, this 
can be remedied by adding the necessary links or, if 20 
necessary editing objects, e.g. by adding buttons. 
[0023] Executing or running an eventstream is one 
of the central functions of the Learning System. Since 
an eventstream is a program in the scripting environ- 
ment EDE, to execute it is to simply run that script. Each 25 
of the objects in an eventstream is an event object and 
executing a multimedia event object is to simply open it 
using the application that created it. 
[0024] Branching in an eventstream, or the links to 
other objects, refers to the structure of the script that is 30 
run when executing the eventstream. At some points In 
that execution the script may prompt for a learner Input 
and, depending on what that input Is, the execution may 
continue in different ways, to different objects. The 
mechanisms used to facilitate these choices are public- 35 
ity devices typical of which are buttons or highlighted 
text strings. Execution of the eventstream proceeds 
when the learner chooses one of these. The corre- 
sponding object is then displayed or run until the point at 
which the next learner Input or choice is required by the 40 
eventstream. 

[0025] Other operations on eventstreams are avail- 
able to a content provider. For example, it is often useful 
or even necessary to back up along the path taken so 
far. A content provider may even be browsing and may 45 
have jumped ahead and need to back up to a previous 
position. The following are some natural operations to 
have available to the content provider while developing 
an eventstream: 

50 

1 . Pass to the predecessor (it is unique by the defi- 
nition of a tree). 

2. Select a predetermined branch with deterministic 
execution to execute. 

3. Pass to a substream using a more restrictive 55 

aspect. 

4. Display other links associated with this event- 
stream's nodes (not a part of the given event- 



stream). 

5. Pass to alphabetical listing of object names in the 
eventstream either using a mouse, input of a key 
combination or other device, e.g. voice prompt or 
touch screen. 

The Basic Learning Cycle 

[0026] Referring now to Fig. 3, the basic learning 
cycle is the basic sequence of learner and Learning 
System acts composing a learning-evaluation cycle. 
This cycle consists of the Learning System's presenting 
material, the learner providing input to the Learning 
System (for example. In response to testing), a compre- 
hension/cognitive evaluation of learner input and an 
updating of the learner's cognitive profile. The Learning 
System will, using the current profile of the learner, 
choose the appropriate version of the next presentation 
in the eventstream being run by the learner. 
[0027] The basic learning cycle is a continuous 
feedback cycle. Each time control passes through this 
cycle it writes to the learner record, logging learner input 
as well as recording Its evaluation of learner perform- 
ance. For example, the learner record will be read when 
the system is determining the level of presentations to 
follow. It writes to the learner record all results of evalu- 
ation. Other sorts of learner input to the Learning Sys- 
tem can also be written to the learner record, like 
choices made using mouse clicks or menu item selec- 
tion. These may be selectively or completely logged in 
the learner record. 

[0028] The presentation of learning material is cou- 
pled with a feedback mechanism for determining 
learner comprehension and ability to apply concepts 
and ^cts. Learner interactions may include discrete 
responses such as true or false and multiple choice, 
however, the preferred interaction is the application of 
presented knowledge to problem solving, including the 
reinterpretation of historical reality based upon the use 
of changed hypotheses. The "What if?" scenarios are 
enabled through Bayesian like networks. Learners are 
also challenged to take the next step in the evolution of 
knowledge by drawing on the historical background 
learned. Having been presented the set of events and 
circumstances that produced an outcome, they are 
asked to attempt to forecast the outcome before having 
learned what it is. Learner responses are assessed for 
content and concept. The assessment of the response 
is keyed to material previously covered so that it can be 
presented to the learner in a focused manner. Learner 
prompting may also be provided in response to incom- 
plete or incorrect answers using a "hint" facility. 

Automated Acquisition of Learner Preferences and Pro- 
file Generation 

[0029] The inference and condensation engine 
(ICE) 26 is the component of the Learning System 
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whose task it is to use the various learner records to 
build the learner cognitive profile. It is the "evaluative" 
component of the system. It reasons about a learner 
record to produce a cognitive profile of the learner. This 
is the process by which the Learning System produces 
a useable summary of the learner's ability, achievement 
level and cognitive style. The precise information 
tracked, the functioning of the inference engine, and the 
methods used to arrive at an adaptive learning strategy 
are discussed below. 

[0030] Before discussing engine 26 in detail, it 
should be noted that engine 26 can be utilized in appli- 
cations other than instructional systems. Given a set of 
user interaction features, engine 26 can be used to cre- 
ate and update a profile based on those features. It pro- 
vides this feature-profile mechanism for stand-alone 
and networked users. An additional example of a profile 
is a consumer preference profile as applied to an indi- 
vidual or group. Such a consumer preference profile can 
be developed by aggregating the cognitive profiles or 
other information concerning a large number of users 
and determining averages or norms based upon the 
aggregate information. This would allow development of 
a global database of learner profiles and behaviors. The 
information gathered from learners can be analyzed 
and assembled into related clusters of learner 
responses and successful strategies for improving 
those responses. Refined strategies appropriate to the 
specific user can be uploaded to the Learning System 
from the network and stored with the user profile. When 
used over a global computer network, such as the Inter- 
net, the presentations (i.e., the event objects) can com- 
prise web pages that are downloaded to the user's 
computer when a request for the content is received 
from the user. Several versions of the web page can be 
stored on the server and the cognitive profile of the user 
then being used by the server to decide which of the 
versions to send to the user. Cognitive profile informa- 
tion for each user can be stored locally as, for example, 
a cookie placed on the user's computer. The server then 
accesses this cookie using it to determine the version of 
the web page that best matches the cognitive style of 
the user. 

[0031] The primary function of engine 26 is to opti- 
mize achievement level, as reflected in learner inputs, 
by matching the form and content of a presentation in 
the basic learning cycle with the cognitive preferences 
of the learner (as embodied in the cognitive profile of the 
learner). The typical responses of an ordinary learning 
assistant to inadequate learner performance would be 
to review the presentation and test once again for ade- 
quate comprehension. Engine 26 may instead vary the 
content and approach of the presentation itself to help 
maximize the comprehension of a given learner. For 
example, a learner's record may suggest that the 
he/she favors material presented visually. Conse- 
quently, the Learning System would choose the version 
of the next event in the eventstream being run whose 



own cognitive style summary indicates a strong visual 
factor. 

[0032] The following sections detail how engine 26 
can be implemented in software to evaluate and update 
5 a learner's cognitive profile and how the Learning Sys- 
tem uses the cognitive profile to select events for pres- 
entation to the learner during execution of an 
eventstream. 

10 Cognitive Profiles and Cognitive Indices 

[0033] Each learner and each event object has a 
cognitive style, and the cognitive profiles and cognitive 
indices are used to provide a quantitative measure of 

15 these cognitive styles. In particular, the cognitive pro- 
files are used to indicate a learner's cognitive style and 
these profiles are updated by engine 26 based on peri- 
odic testing of the learner. The cognitive indices are 
used to indicate an event's cognitive style and are used 

20 in conjunction with a learner's cognitive profile to adapt 
the presentation of material to the learner's cognitive 
style. In the Learning System, this is accomplished by 
providing eventstreams that have not only events 
objects that cover different content, but also event 

25 objects that have substantially similar content that is 
presented with differing emphases on the audio, textual, 
and visual content. Then, the learner's cognitive profile 
is used along with the cognitive indices of these different 
versions of the same content to determine which ver- 

30 sion will result In the greatest comprehension by the 
learner. 

[0034] As will be discussed below, a learner's cog- 
nitive profile is used to provide a cognitive utility function 
that, using an event's cognitive index, provides a quan- 

35 titative result indicating the degree to which the event 
matches the cognitive style of the learner. Thus, to 
determine which of several versions of an event should 
be presented, the system need only determine which 
one results in the greatest value of the cognitive utility 

40 function. The cognitive profile (upon which the learner's 
cognitive utility function is based) can be updated by an 
error correction routine that compares the utility function 
with an approximation of the utility function that is deter- 
mined through testing using preference relations. 

45 

Preference Relations and Form of Cognitive Indices 

[0035] Formally, learner preferences are recorded 
as instances of the preference relation. The Learning 

50 System will identify events with structurally similar con- 
tent and test after presenting these to the learner in ver- 
sions representing different cognitive styles. Based on 
the results it will conclude that one cognitive style is pre- 
ferred to the other. This data will form an instance of the 

55 cognitive preference relation of the learner. This prefer- 
ence relation is then used to construct a cognitive profile 
of the learner. 

[0036] Seen formally, a preference relation is a 
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binary relation on a set of objects. In the case of infer- 
ence and condensation engine 26. those objects will be 
called cognitive indices. Cognitive indices are denoted 
using the letters s and t, while the instances of the pref- 
erence relation for learner L can be abbreviated by 
PL(s.t). Here the letter P is used to suggest the word 
preference and the letter L will typically be a nanne or 
abbreviation of the name of a learner. PL(s,t) is read: 
the cognitive index s is preferred to the cognitive index t 
by learner L. In general, a cognitive index is a sequence 
of cognitive settings or values of the cognitive profile 
parameters: 

(x1, .... xn;y1, .... ym). 

[0037] For practical purposes the settings may be 
partitioned into two groups the first (the x's) being val- 
ues for scaled settings while the others (the y's) are val- 
ues for toggle settings. Examples of scaled settings are 
weights for amounts of video, audio and text in a pres- 
entation as well as the usual scaled settings like audio 
volume and so on. An example of a toggle setting is the 
language of a presentation. Toggled settings have the 
additional property that they are mutually exclusive, 
meaning that only one of the alternatives available can 
be chosen as the setting at any given time. Fixed values 
for all of these settings define a particular cognitive 
style. This style may characterize a package or segment 
of one of the Learning System's events or it may charac- 
terize a learner's own cognitive preferences. The term 
cognitive style will be used in both of these senses. 
[0038] Preference data (or instances of a learner's 
preferences) may be generated In several ways. When 
a learner registers as a user on the Learning System, 
they are beginners (the level component of their cogni- 
tive profile is equal to 0). The remaining components of 
their cognitive profile may be set to the generic or aver- 
age values or initial cognitive testing may be used to 
determine them. This entails giving an equal value or 
cognitive utility to all modes of presentation available to 
the Learning System. This is the way each learner's 
record is initialized. 

[0039] As remarked above, cognitive testing tools 
may also be used to fix the initial values of a learner's 
cognitive profile. A second way in which preference data 
is accumulated about the cognitive profile of a learner is 
In the course of their interaction with the Learning Sys- 
tem. 

[0040] It would be useful to check whether a given 
learner prefers cognitively a Learning System presenta- 
tion (event, eventstream or fragment thereof) created 
according to one cognitive index rather than another. 
Running the same material in two formats and then test- 
ing for the same learner has obvious difficulties. Having 
run and been tested on the first format will effect the 
testing result for the format run second. Two solutions to 
this problem are to collect cognitive preference data 
through parallel and sequential testing. 



[0041] Parallel testing involves presenting material 
in parallel, at the same time, to the learner whose cog- 
nitive formats are distinct. By comparing the distinct 
testing results that arise, it can be concluded that the 
5 higher the test result, the greater the cognitive value of 
the corresponding formatting. 

[0042] The second method of collecting cognitive 
preference data is sequential testing. It involves testing 
on materials that have structurally similar content while 

10 having distinct cognitive profiles. The structural similar- 
ity allows the test results to be compared and used as 
an instance of the learner's cognitive preferences. One 
concludes that presentation with the better of the two 
testing results is also cognitively preferred to the other. 

IS This gives rise to one instance of learner preference 
data. 

[0043] Finally, there is yet another kind of prefer- 
ence data that is generated during a learner's interac- 
tions with the Learning System. These are revealed 

20 through the learner's own choices while interacting with 
the Learning System. Material or objects chosen rather 
than other available options are all indicators of a 
learner's cognitive profile and choosing one is recorded 
as reflecting a preference for that one. This latter type of 

25 preference data is presumably not as reliable as an indi- 
cation of a learner's cognitive functioning as is determi- 
nable through the testing procedures discussed above. 
[0044] Thus, it can be seen that tracking the 
responses of a learner who is using the Learning Sys- 

30 tem is the primary way in which the system creates and 
continually updates a cognitive profile of each learner. 
This behavior includes performance under testing and 
even decisions or choices made by the learner. Based 
on these results a cognitive profile is created and con- 

35 tinuously updated by the system. This provides unproc- 
essed information on learner preferences regarding 
both content and format. 

[0045] Preferences are normally formulated 
between two objects of the same kind. In the case of the 

40 Learning System technology these objects are cognitive 
indices. Each index has been associated with one or 
more Learning System events that exhibit a certain top- 
ical focus and media orientation (or style of presenta- 
tion). The cognitive Indices consist of numerical data 

45 indicating the weight or level of each of the features of a 
presentation. This simplifies the description of the proc- 
esses in engine 26 that act on indices. Cognitive indices 
typically have a fixed number of components, say d- 
many (for example, for an index consisting of a code for 

50 the topic of the content and a code for the video, audio, 
and text weights, four components would be used). 
Thus, the cognitive preferences to be tracked will be 
instances of an ordering relation between d-tuples. 
[0046] The ordering of preference relations permits 

55 a determination of which of the available cognitive Indi- 
ces is most preferred by a learner. As will be discussed 
further below, this ordering of the preference relations 
can be used as an approximation of the utility function 
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for a learner and this approximation can be used in an 
error correction routine to update the learner's cognitive 
profile. 

Analytical Form for Cognitive Utility 

[0047] This section describes the methods used by 
the Learning System for condensing preference data 
into the learner's cognitive profiles and for using these 
profiles to choose the version of a presentation whose 
cognitive index is optimal with respect to the learner's 
cognitive preferences. 

[0048] The first two steps are to determine what 
information is to be included in a profile and how the 
information is to be represented. By coding abstract 
properties of states, the features or properties of a pres- 
entation state can be described by a sequence of 
numerical components. Having fixed the order in which 
the components are listed, it is reasonable to assume 
further that an index s can be represented as a vector, 
F(s), in d-dimensional real space (in fact the possible 
descriptions can be restricted to a discrete finite space 
rather than that of the real numbers). Thus, s is a textual 
description of the cognitive index of Learning System 
material and F(s) is the corresponding vector of numer- 
ical data coding that textual description. If there are a 
total of d-many features (including content topic and 
possibly others), then F(s) is a d-dimensional vector 
(listing d-many different numerical codes for these fea- 
tures or aspects of a state). 

[0049] To determine the utility of a particular cogni- 
tive index (and, thus, a particular event) for a particular 
learner, a cognitive utility function U(s) is used. The cog- 
nitive utility function is a mathematical function that 
operates on an event's cognitive index F(s) to provide a 
numeric indication of the expected effectiveness of the 
event for the particular learner. 
[0050] For the sake of this detailed account of the 
preferred embodiment, it will be assumed that function 
U{s) has the form of a linear function of the vector F(s): 

U(s) = WTF(s), (1) 

where W is a column vector of weights and WT denotes 
the transpose of W. The right hand side of the equation 
(1) is the scalar product of the two vectors W and F{s). 
[0051] Ultimately function F is used to take an 
event e as input and return as its value the feature rep- 
resentation of the event: 

F: E->Rd (2) 

which is a mapping of events into indices, such that F(e) 
is the cognitive index associated with event e. 
[0052] This discussion assumes that the cognitive 
utility of an event e is linearly representable, meaning 
that there are numbers a1 ad such that: 



U(e) = a1 (F(e))1 + ...+ ad(F(e))d. (3) 

[0053] If W denotes the column vector with compo- 
nents a1, ad then the displayed expression can be 
5 written in the form given above, namely: 

U(e) = WTF(e), (4) 

such that U(e) is the vector scalar product of W and 
10 F(e). Thus, the problem of determining a cognitive utility 
function (for states having d-many feature indices) 
reduces to the problem of determining its coefficients 
a1, .... ad of vector W. 

[0054] As used in the Learning System, the vector 
IS W is a quantitative representation of the cognitive profile 
of the learner It will therefore vary from one learner to 
another. The coefficients of W can be initialized and, 
using the cognitive utility approximation discussed 
below, can be updated (adapted) to more closely match 
20 the actual cognitive preferences of the learner. 

Preference Tree Approximation of Cognitive Utility 

[0055] Adaptation of coefficients of the cognitive 
25 profile W can be accomplished using an error correction 
routine which updates the coefficients based on the dif- 
ference between the utility function and an approxima- 
tion of the utility function. This approximation of U(s) will 
be denoted by U(s). This approximation Is based on the 
30 cognitive preference data (preference relations) col- 
lected by the Learning System through testing and other 
means, as described above. The basic principle used in 
formulating an approximation for the value of U(s) is: 
[0056] Cognitive utility is increasing with respect to 
35 the cognitive preference relation. 

[0057] This principle forms the basis of an algorithm 
for computing U(s) based on preference data. Each 
instance of cognitive preferences input to Inference and 
condensation engine 26 results from compared test 
40 results using the methods of parallel or sequential test- 
ing. As discussed above, preferences are represented 
as pairs of cognitive indices, i.e., elements of a binary 
relation PL(s.t). This is shorthand for the statement that 
the index s is cognitively preferred to the index t. 
45 [0058] There is a close relationship between the 
preference relations of a learner and the cognitive utility 
function for that learner. Since a cognitive utility func- 
tion's numerical values themselves are of little impor- 
tance (and only the relative value of different package 
50 profiles), given one utility function for a learner another 
can easily be constructed (e.g. simply add one to each 
of its values). This is due to the fact that it is only the rel- 
ative ordering induced by those values which is of con- 
cern. This suggests a way of passing from a preference 
55 ordering to a utility function and vice versa. 

[0059] In particular, given a preference ordering 
P(s,t), it satisfies certain essential conditions: 



30 



35 



40 



45 



50 



8 



15 



EP 1 008 975 A2 



16 



1 . P's field is finite; 

2. P is anti-symmetric, i.e., P(s,t) implies that it is 
not the case that P(t,s). 

[0060] It may also be assumed that P is transitive, 
sometimes called an assumption of rationality. Proper- 
ties (1) and (2) imply that there are no loops in the pref- 
erence ordering and that every sequence of profiles 
descending in order of preference terminates in a mini- 
mally preferred package profile. 
[0061] The full tree of profiles, ordered in terms of 
cognitive preference relation R can be denoted by TP. 
The minimal elements in this ordering are sometimes 
referred to as a leaves of TP. The two conditions on P 
are sufficient to allow a definition of a cognitive utility 
function based on R denoted by U, by Induction on the 
preference ordering: 

Stage 1: if e Is a leaf then set U(e) = 0; 
Stage 2: if e is not a leaf, then let: 

U(e) = (max{ U{z) : all z such that P(e.z) })+1 . 

[0062] If TP(e) denotes the subtree of TP consisting 
of all sequences below e, then: 

U(e) = |TP(e)| = the height of TP(e). 

[0063] The procedure for defining a preference 
ordering from a utility function Is even simpler. Given 
two profiles s and t, it will be true that PU(s.t) if U(s) > 
U(t). The two conditions above hold and one can show 
that these two transformations are inverses of one 
another in a category theoretic sense. 
[0064] This result can then be compared with the 
value predicted or computed by the current version of 
the cognitive utility function U(s). As the Learning Sys- 
tem's knowledge of the cognitive preferences of a user 
grows with each successive observation of learner pref- 
erence data, it will revise the definition of the cognitive 
utility function by revising the values of its coefficients 
(the coefficients of W). As will now be discussed, that 
revision Is based on the error between the cognitive util- 
ity function U(s) and the approximation U(s). 

Error Correction and Coefficient Updating 

[0065] As remarked earlier, the cognitive utility 
function is completely determined by the learner's cog- 
nitive profile W and. In particular, by the coefficients 
occurring in W. To update these coefficients, the infer- 
ence and condensation engine 26 systematically modi- 
fies the components of W each time it notices a 
discrepancy between U(s) and U(s). based on current 
preference data. The action taken can be expressed In 
terms of an error correction rule. 
[0066] Given an index s, the first step is to compute 
the error term at s: 



E(s) = U(s)-U(s). 

[0067] Then, if wl denotes the ith coordinate of W, 
the update equation Is: 

5 

Wi' = Wl + n{[J{s) - U(s))xl 

where xl is the numerical index of the ith feature of the 
index s and □ Is the updating constant. The updating 

10 constant can as usual be taken to be 0.01. Its purpose 
is to modulate the error correction so as not to have too 
large a variation from iteration to iteration. In calculating 
the error term shown above, it is assumed that the cog- 
nitive utility function U(s) is normal (a utility function is 

15 normal when it maps subjectively onto Its range space; 
i.e., a cognitive utility function is normal if. seen as a 
ranking of profiles using natural numbers, every natural 
number less than the largest one taken as a value of U 
is also a value of U). This says that U Is minimal among 

20 all the cognitive utility functions that rank profiles the 
same way as U. The consequence of the normality of U 
for calculating the error term above is that a non-zero 
error term will lead to legitimate correction in the updat- 
ing process. 

25 [0068] Finally, the cognitive utility function is 
updated based on s by letting the new version of W be: 

(wV wd'). 

30 An Example of Contents 

[0069] As an example of how the Learning System 
functions, the following is a brief discussion of a portion 
of an eventstream. The nodes described here and 

35 shown in Fig. 4 all belong to (are indexed by) topics hav- 
ing to do with the development of astronomy and the 
mathematics of celestial motion. In some cases it helps 
to differentiate between active and passive links. The 
former are captured by the structure of eventstreams 

40 while the latter are hypertext based. 

[0070] The node (40) at which the learner enters 
this eventstream is an event corresponding to the con- 
vening of the Council of Trent. It was organized by the 
Catholic Church in order to take action in response to 

45 the need for reform in the church. Next, there Is a link 
(42) to background on Luther and the event of his 
demands for reformation of the church. This event may 
have still or video images displaying the city of Trento 
and the site of the Council's meetings. The audio por- 

50 tion will be describing the visual Images and may 
include the reading of church documents associated 
with the calling of the meeting. Student onscreen exper- 
iments here would allow the student to derive parts of 
the theory as well as individual formulae, depending 

55 upon student ability. Texts of decrees, in addition to the 
text of Luther's demands, may be displayed on screen 
accompanied by a visual image of Luther himself and 
other central actors In this event. All of this material 
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might also be presented in story form with actors simu- 
lating dialog and interactions during the event process. 
At a separate point there could be a philosophico-histor- 
ical discussion between officials or a third party. 
[0071] Continuing In the example, there might next 
be a link (44) to visual material on Trento and the site of 
the Council of Trent. This may include video or stills of 
graphics as well as an audio description of the scenes 
depicted. Texts of official Council and political decrees 
(link 46) surrounding this event could also be provided. 
Also included could be the actual papal resolutions on 
changes in church practices as well as the creation of 
new church orders like the Paulists and others. These 
documents may be displayed on screen as they 
appeared originally and may be read by the moderator. 
[0072] The next link (48) is to an event describing 
Henry VIII of England's break with Rome in 1531. This 
event will be part of a separate eventstream depicting 
church history and development exclusively. Next, there 
is a link (50) to an event describing Pope Sixtus IV*s 
request that Regiomontanus study the problem of cal- 
endar reform. This event will include visual, textual and 
audio depicting the practical consequences of the 
defective calendar as well as the various forms of the 
calendar in use. 

[0073] The next link (52) is to background material 
describing the discrepancy between the lunar and solar 
months. This discussion would include the methods 
used to make observations and the tools available for 
making astronomical observation/measurement. 
Largely visual, this content will show both relics as well 
as describe the relevant theories of celestial motion. 
Audio commentary is included while text may be 
included that describes in words the material. Addition- 
ally, the presentation could include a complete discus^ 
sion of the mathematics of calendar making, either as 
an optional or passive link. A separate mathematical 
discussion coupled to each of the competing astronom- 
ical theories would reveal the structure of mathematical 
evolution. 

[0074] Next, there is a link (54) to background on 
Aristotle and Ptolemy, the corresponding cosmological 
system and its roots in the history of their ideas. There 
is also a link (56) to events surrounding the effects and 
observation of anomalies associated with the Aristote- 
lian/Ptolomeic view of planetary motion with further 
links (58) to other events in pre-Copernican astronomy 
[0075] Finally, in the depicted portion of the event- 
stream, there is a link (60) to events sun-ounding the 
Pope's secretary's request that the mathematician 
Copernicus give a reliable algorithm for constructing the 
calendar in 1514. These events will include background 
on the mathematical tools and theory available for 
describing planetary motion. The format here is again 
variable and versions which are heavily textual, audio or 
visual are available. 

[0076] To provide proper historical context, the 
eventstream includes two stmcturally similar topics in 



the form of competing cosmological systems, those of 
Aristotle/Ptolemy and that later of Copernicus. Each 
has to give a theory accounting for more or less the 
same set of objects (stars, planets, etc.) and the rela- 

5 tionships between them (one orbiting around another 
and others). This also allows for the cognitive styles of 
the presentations to be varied as desired. In particular it 
accommodates the testing procedures described in the 
previous section on the inference and condensation 

10 engine aimed at recording cognitive preferences. 

[0077] It will thus be apparent that there has been 
provided in accordance with the present invention an 
Interactive instructional system which achieves the aims 
and advantages specified herein. It will of course be 

15 understood that the foregoing description is of a pre- 
ferred exemplary embodiment of the invention and that 
the invention is not limited to the specific embodiment 
shown. Various changes and modifications will become 
apparent to those skilled in the art and all such varia- 

20 tions and modifications are intended to come within the 
scope of the appended claims. 

Claims 

25 1. Instructional system for constructing an adaptive 
interactive educational presentation for use by a 
learner on a computer workstation, comprising : 

means for providing a plurality of related event 
30 objects, each of which includes different con- 

tent that is topically related to the content of the 
other of said event objects, and each of which 
has at least an audio, textual, or visual compo- 
nent that can be presented via the computer 
35 workstation; 

means for providing a number of additional 
event objects, each of which includes content 
that is substantially the same as the content of 
a corresponding one of the related event 
^0 objects, and each of which provides a presen- 

tation of content that is different than the pres- 
entation provided by the corresponding related 
event object; and 

means for providing an eventstream having the 
45 structure of a branching sequence of nodes. 

each of the nodes representing one of the 
related event objects and any of the additional 
event objects con-esponding to that related 
event object. 

50 

2. Instructional system according to claim 1 , wherein 
said means for providing the eventstream com- 
prises means for providing a script that identifies 
the event objects within the eventstream and that 

55 defines the branching sequence of event objects. 

3. Instructional system according to claim 1 or 2, 
wherein different event objects having substantially 
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the same contents have differing emphases on the 
audio, textual, and visual components used in their 
presentations. 

Instructional system according to one of the pre- 5 
ceding claims, further comprising means for provid- 
ing an index for each of the event objects, wherein 
each index contains information concerning differ- 
ent attributes of the presentation provided by its 
associated event object. io 

Instructional system for computer-based learning, 
comprising : 

means for providing a plurality of computer- is 
based presentations, wherein some presenta- 
tions provide different topically-related educa- 
tional content and other presentations utilize 
different cognitive styles to present substan- 
tially similar content, and wherein the different 20 
cognitive styles each has a cognitive index 
associated therewith; 

means for providing a cognitive profile for a 
learner; 

means for selecting at least one of the other 25 
presentations using the cognitive profile asso- 
ciated with the learner; and 
means for providing the learner with an ordered 
sequence of the presentations that includes the 
selected presentations. 30 

Instructional system according to claim 5, further 
comprising : 



quantitative data each indicating the extent to 
which its associated attribute is present in the 
presentation; and 

the cognitive profile comprises a set of param- 
aters, each of which can be associated with a 
different one of the attributes and has a 
numeric value indicative of the preference of 
the learner for its associated attribute. 

8. Instructional system according to claim 6 or 7, fur- 
ther comprising means for iteratively repeating said 
testing, determining, updating, and selecting proce- 
dures to thereby adapt the presentation of contents 
and increase the comprehension of the learner. 

9. Instructional system according to one of claims 5-8, 
wherein the means for providing a cognitive profile 
further comprises means for testing the learner 
using presentations having different cognitive styles 
and means for determining the cognitive profile 
using the cognitive index associated with the cogni- 
tive style that resulted in the greatest comprehen- 
sion by the learner of the contents presented during 
testing, and wherein the system further comprises 
means for aggregating information about a large 
number of learners' cognitive profiles. 

10. Instructional system according to claim 9, further 
comprising means for providing new presentations 
having a cognitive style that is selected based upon 
the aggregate information. 

11. Instructional system for presenting information to a 
user on a computer workstation, comprising : 

means for providing a plurality of computer-dis- 
playable presentations, some of which provide 
different topically-related content and others of 
which utilize different cognitive styles to 
present substantially similar content, wherein 
the different cognitive styles each has a cogni- 
tive Index associated therewith; 
means for providing a cognitive profile for the 
user; 

means for selecting at least one of the other 
presentations using the cognitive profile asso- 
ciated with the user; and 
means for providing the user with an ordered 
sequence of the presentations that includes the 
selected presentations. 



means for providing a utility function that uti- 35 
lizes the learner's cognitive profile and that pro- 
vides a measure of the teaching utility of each 
of the cognitive styles; 

means for testing the learner to determine 
which of the cognitive styles results in the 40 
greatest comprehension by the learner of con- 
tent contained within a presentation; 
means for determining one or more preference 
relations between cognitive styles based upon 
the testing; and 45 
means for updating the utility function based 
upon the determined preference relations; and 
wherein said selecting means further com- 
prises means for selecting presentations to be 
presented to the learner using the utility func- so 
tion and the cognitive index associated with the 
presentations. 12. 



Instructional system according to claim 6, wherein : 

the cognitive indices comprise a set of quanti- 
tative data, at least some of which represent 
attributes utilized in the presentations with the 
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Instructional system according to claim 1 1 , wherein 
said computer-displayable presentations comprise 
web pages and wherein said providing means fur- 
ther comprises means for providing the web pages 
over a global computer network for display on the 
computer workstation. 
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13. Instructional system according to claim 12, further 
comprising means for storing information on the 
user's computer workstation that identifies the cog- 
nitive profile associated with the user. 

5 

14. Instructional system according to claim 13, wherein 
said storing means further comprises means for 
storing a cookie on the user's computer worksta- 
tion, with said cookie providing information that 
Identifies the cognitive profile associated with the io 
user. 
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